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ABSTRACT / 

Nursing curricula and licensing examinations have 
shifted toward the skills and processes of nursir- When these 
components are overhauled, their predictive relationship must be 
reexamined* This research tests the causal influence of several 
antecedent and achievement variables on licensure test performance. A 
path model is developed from a theory of school learning, and the 
causal connections within the model are validated and 
cross-validated. Few significant paths are retained. Student age and 
transfer status show important influences on measures of school 
achievement and on licensure scores. Further , one broad measure of 
school achievement has a substantial direct effect on licensure 
scores. (Author) j 
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PERSPECTIVES AND OBJECTIVES. Eighteen years ago the American 
Nurses Association proposed a four-year university based Program . 
as a requirement to become a registered nurse. The Association 
suggested that such an education should produce a nurse with a 
more diverse* liberal arts preparation than was possible with the 
typical hospital -based program* This broader background was 
thought to improve prof essi ohal nurses' problem solving skills. 
After that proposal, the National Council Licensure Committee 
determined to revise the National Council Licensure Examination 
for Registered Nurses (NCtEX) to emphasise the nursing process 
model of care (Infante, 1982) . It was argued that a testing 
shift toward problem solving woul/d improve the relevance of the 
Licensure examination- The te£t was to be? based on a 
comprehensive critical incident study of nursing behaviors from 
over 12,000 documented epi sbdes where riursi hg behaviors 
significantly affected care (Sanders et al . ^ 1983). 

The new NCLEX was first administered in duly^ 1982 arid 
has been administered three subsequent timef. There are no 
empirically based boncurrent, construct or predictive validity 
data available to date regarding the exam,/ The descriptive data 
published suggest that the national passing rate of candidates 
taking the exam is generally oh par with the results of the 
previously used testing format (Anon., 1983a) with the? exception 
of California candidates. In that state the passing rate is the 
1 owest in five years , possi bl y the 1 owest of all ti me. Thi s 
situation disturbed the Cal i f orni a State Board of Registered 
Nurses enough that they promised to develop their own test if a 
validation study of the NCLEX revealed cultural bi as or a lack of 
job related validity (Anon , 1983b). Progress on the proposed 
validation study has yet to be reported. o 
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.Following the ANA proposed requirement of a four year 
university BSN degree for feqi stered nurses arid the anticipated 
alteration in the NCLEX evaluation of prospective nurses, the 
University of Connect i cut (UCONN) began an eval ua- ti oh and 
revision of its cinder graduate nursing curriculum. The 
restructured curriculum is based on an integrated educational 
model rather than a separate systems approach common :in nursing 
schools* In 1976, the first Bachelor of Science in Nursing (BSN) 
class prepared in the r revised clirr i cul um was graduated, 3uly^ 
1982 marked the first occasion that a UCOfviN graduating class was 
examined with the newly Revised NCLEX. A second graduating class 
from the UCONN BSN program /sat for the nursing boards 
administered in July, 1-983; 

The general objective of this research is to determine 
the extent to which variation .in MCLEX scores can be explainecl by 
a set of aritecedeht_vari ables. The arrangement of the variables 
follows Bloom's (1976) Model of School Learning. Bloom proposed 
that learner entry characteristics interact with instructional, 
variables to cause learning outcomes. In our research, several 
variables corresponding to parts of Bloom's model are 
incorporated into the causal modeling technique of path analysis. 

METHOD - The Use of correlational data to test causal 

models requires explicit hypotheses about the causal flow of 

variables in consideration. The recurs! v£ path model described 
by Kenny (1979), using standard multiple regression analyses to 
test the causal assumptions, was used in the research described 
here. Qur path model tests the direct and indirect influences of 
selected student entry characteristics and achievement in liberal 
arts and nursing courses on NCtEX performance^ 

Specifically, student age, SAT-math and SAT-verbal , and 
transfer status are considered as entry characteristics.- Coarse 
achievement vari abl es i nclude three constructed grade-poi nt 
averages:^ a nbnhursihg score (GPA-GEN) , based an supporting 
course grades (e.g., pharmacology^; a. nursing course index 
(GPA-NURS) , based on grades in lecture courses presenting 
information on the nursing process and the crisis model of 
nursing; and a nursing clinical course, index <GPA-Et IN) , based oh 
faculty ratings of student performance in clinical settings. 
GPA-GEN reflects 23 credit hours; GPA-NURS, 16 credit hours; and 
GPA-CLIN, 20 credit hours. Table 1 gives means and standard 
deviations for all of these data. / 



Insert Table 1 and Figure % 1 about here. 
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The fully saturated ei ght-var i abl e path model is shown in 
Figure 1. Bloom's theory gives rough direction to the sequence 
of vari abl es, in whi eh entry character! st i cs and the qt.aii ty_6f 
students' educational preparation determine learning outcomes. 

In the original piath model * hot shown here, all four 
entry characteristics were treated as exogenous variables. 
(Exogenous variables are influenced by no other variables in the 
path model ; endogenous variables, by comparison, are always 
influenced by/ other variables under consideration.) Further 
reflection and model testing led to the revised model shown in 
Figure i, where transfer status is converted from exogenous to 
endogenous. In thi s revi sed model , age i s now al 1 owed to 
i nf 1 uence transfer status; 

DATA SOURCES: SAMPLE AND INSTRUMENTS. Validation data 

were gathered -on 72 UCONN BSN graduates who completed the NCLEX 
in July 1982. All students had attended UCONN for a minimum of 
four semesters. Half of the sample had applied to the nursing 
program upon admission to the university; the other half gained 
admittance as either upper division students or transfer 
students. 

to check the stability of results, cross-validation data 
were gathered on 101 UCONN BSN students who graduated and sat for 
the nursing boards in July 1983. Simple univariate screening of 
the data suggests that both samples represent the same 
population (see, for example, TaMe 1). Differences in the two 
samples are discussed in the . Results section. 

— " ^ GPA'-GEN and SPA-NURS score were generated from course 
grades built on objective exams; The GPA-NURS courses and their 
exams are built around specific behavioral objectives, so the 

content validity of the exams is fairly straightforward. 

GPA-CLIN scores are developed from four course grades, each based 
pn low-inference, behavioral checklist observations of student 
performance in clinical settings. Each student received 
evaluations from a minimum of two faculty supervisors across four 
semesters.' The rei i abi 1 i ty of these indices is hot known, but is 
assumed to be. in the range estimated by Humphries <1968) for 

adjacent semester grade-point averages, .60-. 70i_ : 

The NCLEX is a multiple-choice test purported to reflect 
the five steps of the nursing process, and items are centered on 
critical incidents. Sanders and colleagues (1983) describe 
extensive content validation procedures and Rasch modeling for 
alternate forms of the exam, but no traditional reliability 
evidence is offered. 

ANALYSIS AND RESULTS. For both the val i dat i ;or\ i and _____ 

cr oss-val idation samples, standardi _ed resi dual s . were examined as 

a check for faulty. data and out Hers. A single outlier was^ 

detected in the 1983 data* in the prediction of the NCLEX score. 
The* regression was repeated with and without the aberrant, data; 
deletion of the outlier resulted in significant reduction in the 
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standard error of estimate, and the case was deleted -from -further 
anal ysi s. 

The path model shown in Figure 1 required five separate 
nan-hi erarchical mul ti pie r egress i oh anal yses , from whi ch were 

_>rived the path coefficients. These coefficients represent- the 
direct effect of each antecedent var i able on each consequent 
variable* and are synonymous with the standardized Beta weights 
obtained from the regression equations. Thus , a complete set of 
19 path coefficients comprise the 1 saturated path model . 

Because saturated path models may contain irrelevant 
causal paths^ it is common practice to trim the model by deleting 
paths whose coefficients are too small to interpret . In thi s ' 
research , paths whose coef f i ci ents were nonsi gni f i ca nt tp< • 05) 
were deleted from the model. For the 1982 val i dat ion sample, 
this procedure trimmed 15 paths and left only four. These four 
significant paths are indicated in Figure 2 by the numerical path 
coefficients. Like standardized regression weights, path 
coefficients may be compared directly with each other . For 
example, we may conclude that the influence of GPPFNURS is twice 
the influence of age oh GPA-NURS. 



Insert Figure 2 about here. 



In the val i dati on sample, it can be seen that among entry 
characteristics, only age develops paths to GPAs. The positive 
path coefficients from age to GPA-GEN and to 6PA-pRS support the 
hypothesis that age is a direct causal influence of these 
indices. Following Land's (1969) interpretation of path 
coefficients, age is directly responsible for about a third of a 
standard deviation increase in GPA-GEN and GPA-NURS. Age, of 
course ^ is a pro::y variable for other characteristics. Prim- 
arily, age allows the cumulation of other experiences. 
Evidently, these: other experiences cohtri Bute ~i~rr a positive 
fashion to a large portion of 7 nursing coursework. 

Only GPA-NURS shows a significant path to NCLEX , and i ts 
size suggests that a standard deviation improvement in GPA-NURS ;< 
wi 1 1 del i ver a . 58 sta ,dard devi ati on i ncrease in NCLEX scores. 
No entry characteristics give a si gni f i cant path to NCLEX, but 
age is seen to operate indirectly on NCLEX scores , through 
GPA-NURS. In short, age seems to improve GPA-NURS, and in this 
way indirectly influences certification scores^ ■_ 

The absence of any i nf 1 uence of SAT scores is surpr i sing 
and contradicts. much previous literature. It was thought that 
this finding might be idiosyncratic to the small validation 
sample. But the SAT scores were, also unimportant in the 
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cross-validation sample; And SAT scorec did not show enbi 
restriction of range to dampen their influence on later 
performance (see Table 1) ./It may also be that instructional 
efforts in the UCONN Schaol of. Nursing incidentally erase the 
impact of general ability- 

In the cross-validation group, we see a few changes 
in the trimming process* Figure 3 .shows ttite reduced path model , 
which may be readily compared to the yal i Nation model i n Fi gure 
2i The cross-validation data permit the trimming of 13/ of the 19 
paths of the saturat/ed model . Although a , quick compari4on of 
Figures 2 and 3 suggests substantia;! differences between the two 
samples, we will see that the differences are easily explained, 

/ 



Insert Figure- 3 about here- / 



In the validation sample,, age has a direct influence on 
coursewor k , and an indirect influence oh NCLEX scores. But in 
the crbss-val i cjati qh , age shifts some of its influence through 
transfer status to course performance^ and now shows a direct 
path td NCLEX scores. In addition, age now shows an indirect 
influence on 6PA-CL IN, through transfer status. GPA-NURS is the 
only chunk of coursework that directly influences NCLEX scores, 
which is consistent with the valLdati-on results. 

The positive path coefficients from age to transfer 
status, and from transfer status to CPAs, suggest that older- 
students are more likely to be transfer 1 student s , and that 
transfer students are more likely to perform well on coursework- 
The implication seems to be that we may expect greater course 
achievement from older transfer students, arid that those who 
outperform their peers in nursing lecture courses h-^ve a decided 
advantage on the NCLEX exam. Transfer student s. were accepted in 
the 1983 class at only half the rate of the previous class (see 
Tabl e 1) . If there was more thorough - screening of transfer 
applicants in the later cl ass , /that may account for the improved 
relationship between transfer status and course performance. 

The replication allowed by the cross-validation sample 
shows that the path results are fairly stable. Disturbance / 
estimates for each consequent variable are shown ,ih Figures 2 ancJ 
3^ These estimates represent latent or residual causes that are 
not accounted for by the data, and are quite steady between th^ 
two samples. The major shift in disturbance shows up in phe / 
prediction of NCLEX scores. In the 19B3 group, more variation in 
NCLEX scores is explained by variables in the model . (NCLEX / 
variance accounted for,//? 5 *, corroborates this: For 1982, / 
ft 2 - .47; for 1983, .63.) Figure 3 shows that age strengthened 



the explanation of NCLEX performance. 

./' 

DISCUSSION AND CONCLUSIONS; Bloom's Model of School Learning. 

i s hot cl ear 1 y supported by our f i ndi ngs - However , the central 

portion of his model deals with instructional behaviors, 

which we have hot measured. The GPAs occupying the center of our 

path model serve only as crude substitutes for instructional 

behaviors; j 

Major findings of this research revol ye around the / 
influence of age on course achievement and on NCLE* scores^ _/ 
■Older students typically have worked in nursing-related endeavors 
(such as LPNs or nurse's aides) be-fore entry to the BSN program;, 
Perhaps their work experience gives them a boost in entry 
cognitive skills that augments their course performances. At the 
least, previous work experience provides mental scaffolding for 
course material that might otherwise seem like rote memorization. 

The lack of influence from age to GPA-CLIN is out N o v f/ 
synchrony with age's effect on the other GPAs. On the j\ 
surface, it seems that GPA-CLIN, unconnected by any si gni^^^ftfef-i'C^- 
paths, is an inconsequential _ part o ; f the causal model. However , . 
in the cross-validation sample, transfer status is seen to 
influence GPA-CLIN, at about the same magnitude as its influence 
on the 4 other two GPAs, While that connection does not 
automatically justify GPA-CLIN (Jr GPA-GEN, for that matter), 
transfer students seem to have an advantageous repertoire of 
study skills, and it is a reasonable prediction that their higher 
GPAs may induce more skilled performance in the field. That 
prediction, of course, required further refearch. 

One may still ask why GPA-GEN and GPA-CLIN made no 
contribution to NCLEX performance. Bloom's (1954) argument that 
similar variables predict each other seems appropriate here: the 
concepts, skills, and testing involved in GPA-NURS are? much more 
closely aligned with NCLEX content and test format. A tentative 
proposal from this finding is that certification exams should 
assess a broader domain of behaviors, particularly the sorts of 
applied nursing skills emphasised in clinical courses. A 
performance-based subtest, for example, might be more suitable* 
although it is unqoest ipnabl y a more difficult form of assessment 
to develop and administer. 

But there is l/ittle merit in developing a device only to 
reward academic behavior. We first need to show a relationship 
between the various BPAs and 1 ater performance on the job. If 
that relationship cannot' be? demonstrated ^ then it* will be hard to 
justify additional certification test requirements based oh 
GPA-GEN and GPA-CLIN. Finally, we eagerly await results from the 
California State Board of Registered Nurses' research on the job 
relevance of the /NCLEX exam. 
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-TABLE 1 

Means and Standard Deviations, 1982-1983 Samples* 



1982 (N = 72) 19B3 (N = 1005 







X 


S 




X 




S 


AGE 




no 


3 . 38 


25. 


04 


3 . 


69 


TRANSFER 


0. 


43 


0. 50 


0. 


22 


0. 


42 


GPA-GEN 


n> - 


47 


0.46 


2. 


62 




63 


GPA-NURS 




61 


0.35 


2. 


49 


b. 


55 


GPA-CLIN 


■ *— • • 


01 


0. 31 


3. 


01 


0. 


41 


SAT-V 


486. 


94 


48. 41 


494. 


47 


67. 


40 


SAT-M 


530. 


56 


47.02 


537. 


93 


71. 


91 


IsIGLEX 


1954. 


72 


223. 07 


2004 . 


57 


267. 


50 



Nate: AGE is years old: TRANS- is transfer _status jl = yes; 0 
rib); GPA-GEN is gr^de point average in general supporting 
courses; GPA-NURS is .grade point average in nursing lecture 
courses; CPA-CLIN is grade point average in nursing clinical 
courses; SAT-V and SAT-M are Scholastic Aptitude Test scores, 
verbal and math; NCLEX is' the nursing board composite score. 

*SAT scores invoive missing data: in i 1982,, only 36; 
students (50%) had them; in 1983, Si students (817.) . 
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FiSORE J; Saturated Path Model Explaining NCLEX Performance. 
NOTE; Curved lines connect correlated variables where rid 
assumption of causal influence is made. 
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FIGURE 2. Trimmed Path Model, Validation (1982) Sample, 
NOTE: Curved lines connect correlated variables where no 
assumption o-f causal influence is made. 
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FIGURE ^3, Trimmed Path Mods! , Cross-Validation <i983) Sample. 
NOTE: Curved lines connect correlated variables where no 
assumption of causal influence is made. 
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Decomposition of Effects from Trimmed Path Models 



1982 SANPi_E 



1983 SAMPLE 



Direct Indirect Simple 
Effect Effects Eorr. 



Direct indirect Simple 
Effect Effects Corr. 



EFFECTS ON: 



transfer 

from age 



560 



.000 



360 



362 



.000 



.362 



GPA-GEN — 

from age .349 
from trans, NS 



-. os: 



.317 
. 160 



NS* 

263 



■ 0?5 
.038 



. 143 
.301 



GPA-NUP.S — 

from age .297 
from trans. NS 



. 075 



.372 

.323 



NS 
295 



. 107 
.050 



.208 
.345 



GPA-EL1N-- 

frorn trans. NS 
from age NS 



. 181. 
. 197 



.320 

. boo 



.000 
.116 



.320 
.099 



NCLEX — 

from age NS 
from trans. NS 
from GPA-NURS. 583 



17: 



106 



.244 
.213 
.689 



.227 
. 000 
.447 



. 147 
. 132 
.310 



.374 
-.020 
.757 



•NS - ^ nonsignificant effect, 
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CAUSAL INFLUENCES QF SELECTED EDUCATIONAL 



VARIABLES ON NURSING LICENSURE SCORES 



Rob i n D - Froman & St even V . Owen 
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Nursing curricula and licencing examinations have shifted 
toward the skills and processes of nursing. When these 
components are overhauled, their predictive relationship must he 
reekairii. h(>d . This research tests the causal influence of several 
antecedent and achievement variables on licensure test 
performance. T .} 

A path model is developed from a theory of school 
learning, and fche causal connections within the model are 
validated and cross-validated. Few significant paths_are 
retained. Student age and transfer status show important 
influences on measures of school achievement and on licensure 
scores- Further, one broad measure of school achievement has a 
substantial direct effect on licensure scores. 
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